9 



(19) 



J) 



(12) 



(43) Date of publication: 

22.05.1996 Bulletin 1996/21 

(21) Application number: 95117619.7 

(22) Date of filing : 08.1 1 .1 995 



Europaisches Patentamt 
European Patent Office 
Off ice europeen des brevets (11) EP0713 332 A1 

EUROPEAN PATENT APPLICATION 

(51) Intel. 6 : H04N 5/262, H04N 5/275 



(84) 


Designated Contracting States: 


• Kimura, Jun-ichi 




DE FR GB IT 


Hachioji-shi (JP) 






* Saitoh, Tadashi 


(30) 


Priority: 1 7.1 1 .1994 JP 283840/94 


Koganei-shl (JP) 


(71) 




* Okunoki, Yutaka 


Applicants: 


Kawaguchi-chi ( JP) 


• 


HITACHI; LTD. 




Chiyoda-ku, Tokyo 101 (JP) 


(74) Representative: Strehl Schubel-Hopf Groening & 




SEGA ENTERPRISES, LTD. 


Partner 




Tokyo 144 (JP) 


Maximilianstrasse 54 


(72) 




80538 Munchen (DE) 


Inventors: 




Ichien, Toru 






Urawa-shi (JP) 





CsJ 
CO 
CO 

CO 

o 

CL 
LLI 



(54) Method for compressing and decompressing moving picture information and video signal 
processing system 



(57) A method for compressing and decompressing 
moving picture information wherein a key signal is cor- 
rectly reproduced and coding is efficiently carried out, 
and a video signal processing system for implementing 
the method. At the time of coding a video signal, conver- 
sion is carried out for make large a distance between an 
ordinary digitized video signal and a key signal indicative 
of whether an image indicates background or foreground 
for data compression. At the time of decoding the coded 
video signal, the video signal and key signal of the 
decompressed image are separated based on a prede- 
termined threshold and reverse conversion opposite to 
the coding mode is earned out. Since the coding is car- 
ried out with the ordinary video signal separated from the 
key signal, the video signal and the key signal can be 
separated by a suitable threshold from the compressed 
and then decompressed image and thus the video signal 
and key signal can be correctly reproduced. 
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Description 

BACKGROUND OF Tjri E. I NV Ei^TION v; V - . ~t* . - - 

•>•; .)-• :.s ■: .j / v •• * co- ' • 

Jhe present invention, relates to image processing , ,s 

techniques and more particularly, to a technique : which. , 0) ; 

can be especially effetfivejyapplied to a method for com- , : 

pressing and decompressing moving pictures. More. par-. : : 

ticularly, the present invention per&ins v to ^as { , y 

compression/decompression method byj which, when it, io 

is desired fo comb^ ^ ^ 

image to a combined image or video signapor^exa^ ' ], 

a keysignki necessary for it cap be simurt^eo^ly.SMitv " ' 

ably recorded or transmitted together with the,coi^ned ^ ! . 

video signal, and also pertains to a video signal process-.! 1 75 

ing system which can remove the key "signal- from ^ 

combined video signal including the key signal to outpul ,V, 

the combined video signal. . .. . . . , ' " ^ 

There has been i ^nvenfipnglly w0M J^o f wn suicfta , ! 
method as a "chroma key" scheme, wKen it is desired ta:. , W 
superimpose a moving picture on another image tojorm \ ' 
a combined image, for image r picking up a target object ' 
with a solid-color or unf igured background behind it and 
generating a key signal indicative of the presence or 
absence of the background from the background color 25 
for the formation of the combined image, x ~ ■ 1 ,. ; , 

In such a prior art image combining method as menC.v 
tioned above, however, when a moving picture is sub-, 7 e . 
jected 1 to a high-efficiency coding (i.e., dafa 9 , v 
compression) and then to a decompressing operation, '/L^ 
the compressed . ^moving picture cannot always , ( be^ : . \ 
restorejd to th^prjginal I image and thus the key.signaU . 
cannot sometimes be reproduced correctly Fqrtfiis rea r ; 
son, a problem sometimes occurs that such a place . 
(which will be referred to as the background,, hereinafter) ( 3s. 
as to be replaced by another image on thejbasis pfihe r ], 
key signal cannot be correctly replaced thereby^ or cpn-,. 
verseiy such a place (which will be referred Jo as the"for f e : . 
ground; hereinafter) as not to^be r f epiaced by. another, n ]... 
image can be wrongly replaced .thereby. , \ t , r r ,<-:.' ^0- t 

SUMMARY OKTHfe IKIVENJION • \. V , v; m '^t 

It is an object of tlpe pr^sejit invention to provide a . :iu , s 
method for compressing and decpmpres^i ng nppy ing pic^ . : ? 45, 
tures on a high-efficient coding ba^s.which can eliminate . 
the above problem in the pripc^art and pan reproduce.^ 
key signal^ correctly. . . * ,\ m . ' "., Z' f J? " .V:V 

Another p.bj ect. of th e present, invention is to provide, 
a video signal processing circuit which can repj;ocjuce a ; . so? 
key signal highly.accurately and can decompress a mqv^., " . ir{ , 
ing picture subjected to a high-efficiency coding to repro^ , ; 
duce a high quality of driginai image. , . J, 

In accprcfenc,e with an aspect of ^he'prese/itirwenr ^ . 
tion, to achieve the af>ove pbjects there are pr,oy$ejc£a t ' , 
method, and system forjcprrpressing and deranpress> / ^ 
ing a moving picture which includes a step or means fcffo 3 , i' 
performing conyei§ipn.tp..separate.values of aboriginal v 
video signal from, a Value of key , signal, indicative of 



background, or nop-background and a step or means for 
performing reverse conversion opposite to the coding 
mode, and wherein the separation between the video 
signal and key signal from the compressed, and decom- 
pressed image is carried out with use of a threshold for 
discrimination. . . 

In another -aspect of the invention, it is desirable that 
key signals of both pixels adjacent to a target pixel of 
reproduction video information are referred to and when 
either one of the key signals indicates background, the 
key signal of the current pixel is changed to have a value 
indicative of background. ; if; 

With the above arrangement, when the range of the 
key signal and the video signal which may have are 
uniquelyispecifierf^ tp ,make large the distance in signal 
level be^f f enjheprdin^rx.y.ide : Q signal .and key signal 
and tp perform coding thereover,; thaseparation between 
the video an£ :key signals from, the compressed and 
deccHTTpres^ed irnage can be facilitated and thus the 
video and-,key signals can be correctly reproduced. Fur- 
ther, isince the discrimination between the both signals 
is carried out with use of the threshold, the correct sep- 
aration, between the video and key signals can be carried, 
out while avoiding an errpr in the decompressed video 
signal. Furthermore, since the threshold is prepared to 
have a. plurality of values, the accurater separation 
between the -vkJeqj.anGl key signals can be realized. In 
addition,^ .since key signals. of both pixels adjacent to a 
target pixei.of reproduction video information are referred 
tpand when either one of the key signals indicates back- : 
ground, the key.signah pf the current pixel ,|s change^ to 
have p^alue indicative pf background, the reproduction 
of the key signal can be realized at the border between 
the background and foreground; ; _ ■■ f 

BRIEgipESCRIF»f|ONpp r-Z 

Otherjpbjecfe. features and advantages of the inven- 
tion will become apparent from the dejailed^descriptipn . 
of the embodiments taken in conjunction with the accom- 
panying drawings, in which: j.. v : 

Rg.ijl is a bit format of a videa signal in a prior art. 
shgwing.hpw to assign bits of the vide^? signal; not 

7 X includirig^an ordinary key signal;^; . .. . 

Fig. 2 a bit format of a video signal in accordance 
with the present invention showing how to assign 
bits of tt)§ video signal including a key signal, with . 
parjL of, yfdeo information removed; - 0t 
Fig 3 is a diagram for explaining a coding procedure 
when, a video signal having a key. signal included 
therein is recorded and. transmitted; 
Fig; 4 is a diagram for explaining a, decoding proce- 
dure when the key signal and video information are 

• A _z. separated from a video signal subjected to a data 
CQn^e^ion/decompression; . 
Fig, § i^a diagram for explaining a spatial phenom- 
enon which possibly occurs when a key signal and 
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video iriformafiori are separate f?orh a video signal 
subjected to a data ccrrp^essioh/decorhpres'sion; : * 1 
Fiig; 6 \sa blbck diagram of a video signal processing 
(reproducing) circuit in accordance with an erhbod- 
fment of the present invention; and 5 
Fig. 7 is a block diagram of an embodiment of the 
present invention when the circuit of the invention is 
applied-, to a : moving picture reproducing system 
using ah MPEG video decoder for decoding 'a mdv- : 
ing picture;-^ : - ■ J . 1 y • - i : i e ^ f 0 

DESCRIPTION OF THE PREFERRED EMBODP - * " :V 

ME NTS * '> ■' - v • v - *>?• ■ : f; * 

An embodiment of the present invention will - be 
explained with reference to the accompiahyihg drawings. ' 

For - simplicity of : description; 3 explanation wifPbe 
made as to an -embodiment in which e&h of the pixels 
of a video image is made tip of 8 bits: Even when the 
amount df information on one pixel is other- than 8 bits, " 
th e pr esent i nveriti on can be embodied i n a simi jar man- 
ner - : -- ■ ' Vl J '-' ; 

Fig. 1 shows how to assign the bits of a prior Vrt 
video signal not containing a key signal. This video f ifcj- 
nal. as illustrated, has an information amount of 8 bits, 
i.e.. its most significant bit (MSB)' Iy7. bits Iy6, lyS.'iyi," 
Iy3. Iy2. Iy1, ; iand its least significant bit (LSB) lyO. In the 
prior art; however, when it is desired to record or transmit 
the video signal, no consideration is paid to sucn an 
application as to combine the video signal with another 
video signal. 1 In "other words, a method for recording or 
transmitting a key sigrial for use in the image composition ' ! 
or combination is not prepared. ^ " v 

The present embodiment is intended not to add any : 
modification to the prior art recording/transmitting 
method and to record arid transmit a L key signal while 
maintaining compatibility with the prior art. To this end, 
the present embodiment has a bit array such that the 
information on the format of each of the pixels of the 
video signal is partly deleted and instead' a key signal is 
assigned thereto. Although the key signal can be made 1 
up of a plurality of bits, it may be made up of only one bit 
since the key signal is sufficient only to have information 
(such as a flag) indicative of replacement or non-replace- ' 
ment of an image with another image at the time of image " 
composition^ In- the present embodiment, the least sig 1 
nificanl lowest bit lyO was deleted in the video signal. In 
this connection, however, it will be readily appreciated 
that the amount of information of the video signal is not : 
limited tc 8 bits but may be any number of bits. < " - - 

Shown in Fig. 2 is how to assign the bits' of a video 
signal including a key signal when the aforementioned 
method -is applied. Since *the amount of image data 
becomes usually enormous, the*image data is in many L 
(^ses subjected to a data compression when it is desired 
to record or transmit the image. Wheh the image is sub- " 
jected to the data comprfessioh- and* then to c a data 
decompressibni however, the compressed irhagecdhnot " 
be always restored to its original image. In the case of 



20 



25 



30 



35 



40' 



45 



50 



55 



an ordinary video signal, when several of the lower bits 
of the video signal vary, this will substantially not influ- 
ence the reproduction of the Video signal. However, a 
change in the key signal may possibly result in erroneous 
reproduction of the foreground and background: TO avoid 
such situation, in thfe present embodiment, the key signal 
is assigned to the most significant bit (MSB) position 2k0 
whictfiS'leasft'iA^ subjected to 

the data compression arid decompression; 
0 Further, when the key signal has a value indicating 
that tnVyidiBci pixel in question refers to a background, 
the pixeris^r^laced by ^foreground video image in its 
image cpmbinatibri mr^ information on 

the pixel becorries unnecessary! 1 

In this case, it is previously determined to record 
zeros(b^s) (valife) \h bits 2y7 to 2y;! of the video signal, 
so that isi i^vef distarice between the video signal and key 
signal can be made large. As a result, even when the 
data wh^re^iorVdiebpmp video signal 

resurte in" the 'fact that an error occurs fdr the original 
image due to the ' discrete, cosine transform (OCT) 
processing in the date compresiiorydj^orr^ressipn, the 
key signal can be correctly reproduced. 

With the ^bove bit assigning method in mind, expla- 
nation wiirbe made of a coding procedure when a video 
signal including a key signal is recorded or transmitted; 
referring to Fig. 3. In this connection, it is assumed that 
the key signal indicative of a background has a logical 
value of "0" (bit 2k0=0) and the key signal indicative of a 
foreground has a logical value of "1 " (bit 2k0=1). Such 
an assumption will not lose the versatility of the present 
invention; because the reversal of this assignment ena- 
bles implementation of the present invention in the sim- 
ilar way to the above. ^ Accorciingly, in the present 
embodiment it is .assumed that the key Signal has such 
meanihgsksm^fion^/at^e. , , 1 _ 

As shown in Fig. 3, when video information 301 fedh 
responding to one of the pixels of an image is assumed 
to have an information aYfiount of 8 .'bits'' the video infor- 
mation 301 can take values of 0-255 and video informa- 
tion 302 corresponding to the video. information, 301 but 
deleted by one bit can take Valued of 0-127. When the 
above pixel corresponds to part of a foreground of the 
imaged the key^gnlainas £ vdlye of "I". TKereforei "1"' 
is set at the highest bit position and the values of the bits 
of the video signal ate adSId by drioffset value of 128 . 
according to th'e assi^nrifent of the bits of the video signal 
including the aforementioned key signal to be inverted 
to information 303 having aVange of values bf 128 : 255. 
Vtfften the pixel ^rtesponds' to part of a background of 
the image, the key /signal has a value of "0" and its video 
information whicrV becomes unnecessary at the time of 
image combination is also previously set at a value of 0, 
which resultis in thaifa video signal 304 corresponding to t 
the background fias a value of 0 arid thus such informa- 
tion as to take values of UV^be^^ess^erit^ the 
time of ixxjiiig.' ' ■' : ^iiU^^-,^. 

Wrieh the aoove video~~signai i *fe c s^j|cted tb data 
compression and decompression', this causes an error 
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between the original and reproduced jmages, whereby 
there may appear at the time of the. decking a. video y 
signal haying values of 1^12? which has. not ,been r .^ 
present at the time of the codingl To avoid such a vid^eo 
signal error, the key signal and videojnformation are sep- 5 
arated from the video 1 signal^ having the '§r?dr tiaus4d , 
based on the original video Signal: W '.1. 
durefbr the separation w/lT be explaiped with rfefer^nce r 

to Fig/ 4.- • • r' ::'/ ..; ::S:T'.. 

As mentioned atove, there, is theor^ti.^l^^^c^ur^ojj^ 
rence, that the video signal. Has values QfiXil?7.attto n ),;j 
codihg .stage. However, wheih the ; imagfe data! js^sub-- ~ v . 
ject^d to a compression, recorded or transmit^ a/iif^ , 
then subjected to a decompression, an errgr tg^s place , 
between the' oriqiniai ; and repr^uc^^imag[es, /yvhjcb.j J, 5 
results in that there occurs such a situation that the j^r- ^ 
matioh haying taken values of 128-255 as ite initial fafft- 
ground video information 403jakejS values pf 127or l^ss* X <■ 
(information 4dl i ) or the infprmajioh having taken a value! "j, ... 
of zero as the background key signal, takes values of 1, '.20 
or more (information 402). ^ . , . . - », . . 

When a threshold 4d0 fpr Reparation between the 
background key signal and foreground vid^ irtfofiriation t J 
is previously set prior tp tne"dec ( oding/a key .signal 406,,. , 
indicative of the background can, be separated from ...25 
video information 404 containing the fix 
nal by clipping .^e background key signal and ; the .fprer^T - r 
ground video, information with use of the threshold 400. r . tVt 
When the\liey. signal indicates the foreground, the ksy, ^ 
signal (bit 2k0),havjng.a value,pf ;1 "and indicative of.th^ 
foreground is deleted " the video sigoaMs expanded , or, ^ X 
decompressed by a factor of 2, and then restp/ed'tp th^~; £ ... 
original video information (information 405) When me 
threshold for separation between the key signal and the , ti 
videosignal is set to selectively have ayalueof. e.g. v 64^ .35 
96 or 128 (see Fig. 5), even the vjo'ep signal alr^dy sub- < . : 
jected to the coding can be.adjusted at the time of tt|e „ r r 
decoding, ;: , T . \~!/ ~ 

Fig. 5 is a diagram for explaining, a variation in ^ , 
video signal when 'image datk is compressed and t $o t 
decompressed ,(n such a manned as mentioned abpye^ , T. 
as well as £J^atiaI phen^ 

place during the compression 3r$ decompression. Also. % 
shown in Fig. Sjare an jmage ^j^jg. hiving a foregrqurjcl . 

504 and also tiaying a key si^nar indicative 45 
ment of a background 503. t^ - 
image at the tjme ^ pf^mage cpmbin^pn^as well as^a, 
video signal Iqvel. (more "p^icularly,..iurriix|apce signal n .. 

I evel) corr e^qridin^ to any;, one li n e^50 S 8 in the imag$ ( . 1 „ : . , 
In Rg/5, when attentipfVis Jurned,tb.a yio^^ignal ^.50 

505 of an original image pripr .td a data compression, the . v y : 
videojsignal 505 pgrrespprxling to zones_of .50b-50c and.^., , 
50d-50e corresponds to part of the iForegrpund, t he vjd $0 , . \ \ . 
signal 505 has values higher than a thresjipM^ ] Ay . 
the video signal 505 corresponding to zone§:pf-5Q^ 55 
50^-50d;ahd 50e : 5pf other ^anlhe.at^e^pn 

50c and.5M-^e)j^s ( a"v^^^ A"yid^ ; ^ 
subjected'tp a dat^cpl^f^^iorV^ r '" : 
error with respect to the video signal 505 of the original ' ^ 



image. In orcjer to avoid gninformation error caused by 
the error between the original and compressed/decom- 
pressed video signals, suitable .thresholds 509-511 are 
set fo separate the? key signal from trie video signal. How- 
ever, jn the border between ihe foreground and back- 
ground, even when these thresholds ,are critically set, 
there may opcur levels 507 . and ,508 : such that the key 
signal cannot be correctly separated frorn the video sig- 
nal " ' ' " C '[ • I "■' -_" r 

r c jln .such a cas^e, means for, adjusting the key signal 
is provicl^.sp as ta^llow selectipnof expansion or non- 
expanstoaofj the background key signal, in the decoding 

the woFd "expansion" of Jh§ background key signal 
.means that image data .is^u^jfc^ecfitaa line or. raster 
scan while (key. signal^ oj adjacent^ thereto are referred 
to, sp yjat^if, erthep one or both of the adjacent key signals 
indicate the background, then the key signal of the cur- 
rent pixel i^alsoiregardjed to have rvalue indicative of 
the background. This enables the key signal erroneously 
reproduce^ at the border between the. background and 
foreground to be appropriately adjusted 

turning now to Fig. 6, there is ^hown an example of 
an image reproducing ;circu it as an embodiment of the 
method of the present invention. Jn Fig. 6, a key-signal 
enable/disable signal indicates t wheth§r an input video 
signal contains a k^ViSignal or is an ordinary video signal, 
not containing the key signal, and i% discriminated from 
the inputvideo signal by^ CPU 2, explained later. A key- 
signal expansion enable/disable signal , specifies the 
presence, or absence ,of -key signa^expansion. A thresh- 
old change-over signal is^used to change a threshold for 
use in separation between the key signal and, video infor- 
mation. These signals should be knpwn by a person who 
operates i chroma-key control. -Accordingly, it is neces- 
sary that these signals are, jnput to the video signal repro- 
ducing cir^uft 60,frpm thg QP.U 2,.(refer to Rg r 7) of a 
video signal processing circuit, separately from the input 
video signai andthethr^sholdf,^ ; : ; ^ 

The operation of the video signal f eproducing.circuit 
60 will .be. explained in conjunction with a flow of data. ; 
Whep ihe tey signal en^e/disable signal received from 
the CPU ? is adis^bleindication, i.e., that pe input video 
signal contains noi key signal^ the input video signal is 
selec^ecj, ( at a.* video "signal change-over ^. .circuit 605, 
delayed at a d^.lay circuitJSOy, and then supplied as it is . 
to a YC- RGB conversion circuit 61 1. and a combining cir : 
cuit 612. . At^this time, the foreground key signal is - 
selected in a key-signal change-over circuit 606 due to ; 
the key-signal enable/disable signal Indicative of the dis- 
able and delayed ^t a delay circuit 608, and then applied, 
to a keyTsignal; expansion circuit 6,10 of the next stage. 
Sines the key signal is also delayed at a delay circuit 609 
and then applied to the key-signal expansion circuit 610. 
three,gputs to the key-signal, expansion circuit 610 all; 
indicate-^the fpreground .key signals and the key-signal 
expansipri. ienable/disable; ; signal ^ becomes invalid, 
whereby the foreground key signal is supplied from the 
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key^signal expansion circuit 610 io (He combining circuit 
e^asitis'. ■ ' :o n -' ;* '■' - ''■ * ; " ; ' !: " ! ; 

- When the key-signal enable/disable signal indicates . 
the'enable, i.e., that the input video signal contains the^ " 
key Signal', '8 bits of the input video signal are separately 5 
divided into the key signal and the video signal in a£cprd : 
ance with the aforementiohed decoding procedure using 
the threshold. More in detail, the video signaNs first sub- 
jected at a clipping circuit 603 to a clipping operation at 
values-of 1 28-256/ Atthis' time, if the input video signal 10 
has valued of 1-127, fran'fhe clipping circuit 603' regards * M 
the inpui video'sighal to hafve a valueof 123.' The i video : J 
signal subjected to the clipping operation is corrected by ; r ' 
a correction circuit 604 so that values of "1 28 256 corre- 
spond to 0-254. This correction is carried but by an arith-' 75 
m etic operation such that " 1 28" is" subtracted from th e' fi ' J 
values clipped by the Clipping circuit 603 'and 'tfieri'mul-' ■ 
tiplied by ; 2J — : V'- : " " ,T - ry v:: -v '*-"'* '•• ■' * - ' ,v 

Subsequently; the video 1 information subjected to the 
correction is selected at the video signal change-over cir- 20 
curt 60S, "delayed at the dela^ circuit 607 and supplied to 1 
the YC-RGB conversion circuit 6i t where corwersion 
from Y (luminance) arid C (chrominance) signals to RGB 
(red, green f and blue) signals is carried but. And in the ' 
combining circuit 612, the video information is combined £5 
with'a border color signal of/e:g:; blue set by the CPlLT 
on the basis of the key signal received fibrrvthe key-sig- ^ 
nal expansion circuit 61 O'to generate an output video sig- ; : | 
nal which in turn is output frortf the combining circuit 612 ■ ^ 
to such a monitor display unit as a CRT. '"" ' f ' ? 3<? 

When the key-signal enable/disable signal is enable^ 
extraction of the key signal from the inpui video signal is ' : 
simultaneously carried out. -Thai is, the input video signal ' u ' 
is compared with the thireshbld at a comparison circuit ' : 
602. Used as the threshold is the value of, 'e.g.!, 64" 96 35 
or 128 seleetec; by a threshold charige-oversignal pre- r " 
viously specified in a threshold changeover circuit' 601. 1 ; 
As a result of the comparison 'between the input vided^ /r J 
signal and the threshold, when determining that the input' 
video signal is larger than the^threshold, the comparison 40 
circuit 602 outputs the foreground' key signal; whereas, ' 1 * \ 
when determining that the input video signal is VmalieT ' 
than the threshold, the comparison circuit %OZ outputs ; ~ : 
the background key signal. The key signal is selected at- ' 
the key-signal -change-over circuiV 606 and applied ~ 4s 
directly to* the Key-signal "expansion circuit 610, or at - 
delayed at the delay circuit 608 or at the delay circuits 
608 and 609 iand then applied to the key-signal expan- ": J 
sion circuit 610. : ; : . ■ . • . ' l :. 1 ^ 

In this case, the output of thedelay circuit 608 ts the "so 1 
key signal of the current pixel. When the input video sig- 
nal is received with line 1 scan or raster scan, the output 1 
of the fcey^gnal change-over circuit 606 and the output 
of the defey circuit 609 are the key signals of pixels * at its'' f 
left-hand and right-hand adjacent to the pixel of the key ' 55* 
signal corresponding to the output : of : the delay drcuri 
608. TTie key-signal expansion dfcuit 610 refers to the 1 ^ ^ 
key signals of the left/right adjacent pixels and the key :nvs 
signal of the current pixel, outputs the foreground key sig- 
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nal only vvhen^ali of these key signals indicate 'the/fore- 
ground and otherwise outputs the background key 
signal, thus realizing the expansion of the background 
key signal. ' l ; ' ' ^ . '' t '' \ " / " 

.Shoyvn in Fig. J^isa block diagram 1 of an embodiment 
of th*e present iriyehtion when the reproduction circuit of 
Fig. 6 is applie^.to.such a paving. picture, repr^ 
system that uses ah MPEG video decoder (movirig.pic- 
ture decoder) 10 based on yidep specifications called 
1 MPEG (movirig 1 picture experis/^rqup): Pribr to expiaha-. 
tion of the moving picUjre reproduction system of the . 
present en^'cxjimentl explanation will be made of an 
example of & recording system for a CD-ROM irf wfrch 
rrrovTng pi^ure^d are recorded! A digital video signal 
to be rjecorded, which contains a luminance signal Y, 
chrominance signals Cb and Cr. is input to a preprocess : 
ing circuit. Trie component Y, which is made up of, e.g., 
8 bits? is snifted toward the LSB side sequentially by one 
bit arid *r is set ' air the MSB usinjg ai shift register. 
Through this snifting operation, the LSB of the Y compo- 
nent is discarded. The chrominance signal Cr is output 
as it is arid also applied to a coihddence circuit. The coin- 
cidence circuit for detecting a coincidence with a preset 
ba<^grour^c«lor such as blue or black judges the pres- 
ence or absence? of the background and generates the 
aforerhentioned kby signal. The key signal from the coin- 
cidence circuit is applied as a selection instruction signal 
to a selector circuit which selectively receives an output 
from tf)e,shift circuit iand a preset value cprresppndihg to" 
the ^ ^ntponeht signal regarded as ah all 0 signal. 
Whetfthe key signal has a value of "0" indicative of the 
background; the selector circurt selects the Y component 
having a value of 0; while, when the key si^har.has a 
value of "1" indicative of the foreground, the selector cir- 
cuit selects and outputs the'Y component ^ output shifted 
by the shift circurt and a value of "1 " at the MSB. 

The3 r compbnenis issued from the preprocessing circuit 
are applied to an encoder to be subjected therein to an 
encoding Operation ineHudihg a known MPEG encoding 
fbr data 1 cbnipressioh, and then 1" recorded in such a 7 
recording medium as a CD- ROM ats ."a video'signaf. At 
the rjiTi'e of the data compressiori/ a signal level differ- 
ence between the background and foreground js decom- 
pressed in accordance with the principle of iFig. 3. * 

Turnlng^agaiin to Fig. r 7, the moving pidture.reprdduc- 
tion system of the^present ernbc^imeht, as shown, 
includes a Cri-ROM driver 1 for reading otrt moving pic- 
ture data stored as co^re^ed/coded in a CD-ROM, a , 
microcomputer '(CPU) "2 fbr separatedly dividihg the 1 ; 
r^ad-dut data into 1 image data arid voice data and alsb 
for decoding "control information, an MPEG audio 
decoder 3 for decoding Ihe separated moving picture 
data. arvMPEG video decoder 10 for decoding the.sep- 
arated moving picture data, and a video signarreproduc- 
ing circuit eo havihg 5 such i a structure as shown in Rg. 6. 
A moying .picture ("signal decoded by^ the MPEG video 
decoder 10 is sent tfirbugh the video sighai reprbducihg ' 
circuit 60 to such a monitor ias a CRT display unit, while 
the decoded audio signal is sent to an audio amplifier, in 
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this case, the background image signal may be provided, 
e.g., from the CPU '2? "'' " ; " ' ' 

Also included . in, th^ ? movjng ^picture, reproduction 
system are a read/ipnly irifempry 4 fqr storing therein, a 
program to be>xecuted byi'tb.e CPU 2.$hp Jjxed $at^ a 5 
randomly r^idabie^rjt^le, memory 5 us^^a-.w^k 
area of the CPU 2. and a buffer memory, (frame memory) 
20 connected to the MPEG video decoder 10 for tempo- 
rarily holding the decoded image data therein. The 
MPEG video decoder 1 0 and the video signal reproduc- 10 
ing circuit 60 are made in the form of a single chip LSI. 
The LSI chip has been marketed under the name of 
MPEG 1 Decoder LSI HD814101F later than the date of 
the convention priority claimed for the present applica- 
tion. However, the chip is not intended to disclose as the 15 
prior art. 

Although the present invention made by the present 
inventor has been explained in detail in connection with 
the embodiments, it wiH; be appreciated thatthe invention 
is not restricted to the specific embodiments but may be 20 
modified in various ways without departing from the spirit 
and scope of the invention as defined in the appended 
claims, as a matter of course. For example, the foregoing 
embodiments have been explained in the connection 
with the case where the input video signal is of a digital 25 
type, the present invention may be applied even to the 
case where the input video signal is of an analog type. 

As has been explained in the foregoing, in accord- 
ance with the present invention, the need for modifying 
the prior art system for recording or transmitting known 30 
data compressed/decompressed data can be elimi- 
nated, the key signal for use in the video signal combin- 
ing or composition can be recorded or transmitted as part 
of the video signal, and the key signal can be correctly 
restored or reproduced without being influenced by an 35 
error generated during the data compression/decom- 
pression. 

Claims 

40 

1 . A method for compressing and decompressing mov- 
ing picture information, comprising, at the time of 
coding digitized moving picture information, the 
steps of: 

in coding. 45 

converting an original video signal through a 
predetermined processing procedure to cause dis- 
tances between values of the original video signal in 
a range of values taken by video information and a 
value of a key signal incficative of background or non- so 
background to be offset; 

coding the converted video signal to obtain a 
compressed (MPEG) video signal; and 

in decoding. 

decoding the compressed video signal, sep- 55 
arating the key signal and the video signal therefrom, 
and then performing a reverse transformation oppo- 
site to the coding mode thereover to cause the offset 
distances between the values of the original video 



signal and th^ vaJueof-the key signal to be restored 
to their original, values. . .. ; f .- , 

. • v * » > . ' c ~ 

2. A method for compressing and decompressing mov- 
ing pipture, information as set .forth in claim 1, 
wherein, at the. time of said decoding, to remove an 
error generated, betweerva^reproduced image and 
an original image, a threshold is provided for sepa- 
rating the video signal from the key signal to deter- 
mine a. reproduced video signal and a reproduction 
key .sifjnaf from ^aid reproduced, image on the basis 
ctf s^id^ . ! *v 

3. A metho^ for compressing and decpmpressing mov- 
ing ;i picture information ,as ^et forth in claim 2, 
wherejn said threshold is prepared^ to have a plurality 
of. yalues;an^ any of the yajuesjof said threshold is 
selected.tp adjust r^prpdu^pn. of the reproduction 
ima<je and key signal to match a separation degree 
between a foreground and a background at the time 
of said coding, .. . . j : . v fr .. , . 

4. A method for compressing and decompressing mov- 
ing picture information ; as set forth in claim 1. 
wherein key signals of both pixels adjacent to a tar- 
getpjxel of reproduction video information of line 
scan or raster scan are referred to and when either 
one of . said key signals jndipatqs background, the 
key signal of the current pixel is changed to have a- 

: , value indicative of background. - . , ; 

5. A videp signal, processing system comprising: < 

. . a clipping, circuit (j503) for extracting from an 
input digitized image signal a video signal other than 
; a key signal c indicative, of background or ; npn-back- : 
ground; r , , r: - 

.... r a correction pircuit (604) for correcting an out- 
put signal of said clipping circuit to correct the video 
signal in a range of values taken by an original video 
. signal; 

^ a comparison circuit (602) for comparing said 
input image signal with a preset threshold to judge.;, 
whether or not the input image signal includes said 
key signal and outputting the key signal indicative of 

.. t contents corresponding to the judgement result; and 
j-. : j synthesizer circuit (61 2) for outputting a video ; 
signal indicative of background when the key signal 
indicates the background on the basis of the key sig- 
nal issued from said comparison circuit and for out: 

( „ putting a .video, signal from said correction circuit ( 
when the key signal indicative the non-background. 

6. A video signal processing system as set forth in 
claim 5. further comprising a conversion circuit (611) 

. for.converting the video signal corrected by said cor- 
rection circuit to a video signal suitable for a display 

unit,,,, . i , tt - y ... . ; ^ r . ^ 
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A video signal processing system as set forth in 
claim 5, wherein said input digitized image signal 
has data pixels each made up of a predetermined 
number of bits, a key signal indicative of background 
or foreground is assigned to the highest of said btfs; j 
and video signals With the lowest bit of anorigirfer 
image .being disdarded'are'assignecf to the remain- 

A videb^signal processing [ syistem as set forth' in 
claim' 6rfurfher c6rnprfeing a threshold arcuit^(601J 
for selectively setting said threshold; and key Signal 
expansion circuits (606-610), with respect to each 
of pixels of 'an input video signal of a 'fine > scan dis-' 
play, for- changing reproduction key signals of* the 
pixels to have valu'e& L lh^icative'6f 'th'e' background 
when either one of the* reprbdu^^ 
the pixels adjacent to thetarc^^^ of 
the background. : " r rV . ■■ 'Q v. • .■-? - 

A method for coding a digital video signal of a line 
scan type including moving picture information, 
comprising the steps of: ; ; \ -^^ 

r 7 separating an input digitized video signal into 
a luminance cbrrpbriient 'and' a plurality of chromi- 
nance signals with respect to each of pixels thereof; 

; shifting said luminance tornponent sequen- 
tially by one 'bit 'toward a least significahrbit (LSB) 
side in a rdw'bf a predetermined number 6f bits with 
respect to each of the f pixels of the video signal to 
assign a key signal indicative of whether the video, 
signal belongs to a background 6r foreground of the 
image-to a most significant 'bit (MSB) : 6f said bit row; 
' - - comparing said plurality of chrominance £ig- r 
nals with a prespecif iki : backgrouHd color ^gener- 
ate a key signal; 

■- outputting- a luminance componehV repre- 
sentative of said shifted bits 6r all the bits having yai 1 ^ 
ues * of 0 r i n accordance " with said generated key 
signal; and 

: - .combining said output luminance component 
arid -said plurality r 6f } chrdmihance signals for data/ 1 
compression. }r - J / :. ~ : 

i^NM: : b- ; ;^:^ : .-- 

AVffethod for decoding a 'digital video signal of a line 
scan ' < type" incl ucf ihg moving picture infor nriati on , 
comprising the %teps of: ^ ^ lf 

. J ^extracting; from an input digital irnage sigrt^ 
subject end to a data formatting and having a key sig- : 
nal !t indicative- of background or non-background 
assigned to a most significant bit and a least signif- 
icant bit removed, the video signal of each pixel other 
than said key signal; " r- * " : x ' ' - * ' ■" 

' ! ; correcting said extracted video signal to have 
values In a range* of Values taken by the'originar 
video^signal; \' iJ -:. ."- - -s- ; o v no 

comparing a preset threshold with said input 
video signal to judge whether or not said input video 
signal includes said key signal and to generate the 
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key signal* corresponding to the judged, contents; 
and ' 

!:> " b^ the 
background when thW key signal indicates the back : 
ground on the basis bf the'generated ke£ signal and 
ouiputti ng said bo'rrected vid eo signal wh en th e key 

sigiiaf indicates nori L backgrburid. 

-c.!r.:t.v .r.-oi- -"" *' ■ 

t .HT .r,v . ■;; r-:>-i- <;•''£:.■/ \.,-^-^ -•■ • - 

to &ir.i.n ;:r\> vy^-r ' ' : : f o 

'^;"t; - : -J.- lb ! * 1 * * " * '. " 
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